Evaluating Compound Splitters Extrinsically with Textual Entailment
نویسندگان
چکیده
Traditionally, compound splitters are evaluated intrinsically on gold-standard data or extrinsically on the task of statistical machine translation. We explore a novel way for the extrinsic evaluation of compound splitters, namely recognizing textual entailment. Compound splitting has great potential for this novel task that is both transparent and well-defined. Moreover, we show that it addresses certain aspects that are either ignored in intrinsic evaluations or compensated for by taskinternal mechanisms in statistical machine translation. We show significant improvements using different compound splitting methods on a German textual entailment dataset.
منابع مشابه
Distributional semantic models for detection of textual entailment
We present our experiments on integrating and evaluating distributional semantics with the recognising textual entailment task (RTE). We consider entailment as semantic similarity between text and hypothesis coupled with additional heuristic, which can be either selecting the top scoring hypothesis or a pre-defined threshold. We show that a distributional model is particularly good at detecting...
متن کاملChinese Textual Entailment Recognition Enhanced with Word Embedding
Textual entailment has been proposed as a unifying generic framework for modeling language variability and semantic inference in different Natural Language Processing (NLP) tasks. By evaluating on NTCIR-11 RITE3 Simplified Chinese subtask data set, this paper firstly demonstrates and compares the performance of Chinese textual entailment recognition models that combine different lexical, syntac...
متن کاملIntrinsic and extrinsic approaches to recognizing textual entailment
Recognizing Textual Entailment (RTE) is to detect an important relation between two texts, namely whether one text can be inferred from the other. For natural language processing, especially for natural language understanding, this is a useful and challenging task. We start with an introduction of the notion of textual entailment, and then define the scope of the recognition task. We summarize ...
متن کاملActive Learning-based Local Graph Matching for Textual Entailment
This paper presents a robust textual entailment system using the principle of just noticeable difference in psychology, which we call a local graph matching-based system with active learning. First, although an early textual entailment task often involved two rather simple sentences of T (“Text”) and H (“Hypothesis”), the recent textual entailment task often involves multiple / complex / compou...
متن کامل"Ask Not What Textual Entailment Can Do for You..."
We challenge the NLP community to participate in a large-scale, distributed effort to design and build resources for developing and evaluating solutions to new and existing NLP tasks in the context of Recognizing Textual Entailment. We argue that the single global label with which RTE examples are annotated is insufficient to effectively evaluate RTE system performance; to promote research on s...
متن کامل